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Abstract 

This note describes two problems related to the digital 
implementation of control laws in the infinite dimen- 
sional family of matching control laws, namely state es- 
timation and sampled data induced error. The entire 
family of control laws is written for an inverted pendu- 
lum cart. Numerical simulations which include sampled 
data and a state estimator are presented for one of the 
control laws in this family. 

1 Introduction 

Several papers have been written recently regarding the 
control of nonlinear underactuated systems Q-Q- Re- 
call that an underactuated system, is a system with 
fewer control inputs than degrees of freedom. The idea 
that one should look for control laws such that the 
closed loop system takes a particular form is common 
to all of these papers. The particular form of the final 
equations is chosen so that there will be a natural candi- 
date for a Lyapunov function. If the Lyapunov function 
attains a local minimum at an isolated point, then this 
point is a locally asymptotically stable equilibrium of 
the continuous system. 

Digital implementation of continuous control laws in- 
troduces additional difficulties. It is not a priori clear 
that a method which produces good results in the con- 
tinuous case with full state feedback will continue to 
produce acceptable results with state estimation and 
sampled data. For a digitally controlled system, the 
data is collected and the control input is calculated 
at discrete moments of time. In addition, the full 
state cannot be directly measured and must be esti- 
mated based on observable data. Assume the continu- 
ous closed-loop system is modelled by 

& = f(x,u(x)), (1) 

tDept. of Mathematics, Visiting from Steklov Inst, of Math., 
St. Petersburg, Russia 
tDcpt. of Mathematics 

' Department of Mechanical and Nuclear Engineering. 
This work was partially supported by NSF Grant No. CMS- 
9813182. 



where u is a full state feedback control law. Let r be 
the sample time, let Xk = x(rk), let yf. = C(xk) be the 
observerable data, and let x k be the estimated state 
at time rk. A model of a corresponding digitally con- 
trolled system is 

x{t) = f(x(t),u(x(t)), 
x(t) = x k , for rk < t < r(k + 1), (2) 
S.k+1 = 9(yk,x k ), 

where g is the state estimator. In practice, it is not 
system |l|, but rather system (Q), which must have an 
asymptotically stable equilibrium. There is a lower 
bound on the sampling time, r, dictated by the control 
apparatus. There is an upper bound on r depending 
upon the state estimator and the control law. 

For a simple linear system corresponding to f{x, u) — 
Ax + Bu(x), y = Cx, conditions to make (||) asymptot- 
ically stable are well known. For the continuous closed- 
loop system to be asymptotically stable, there must ex- 
ist a matrix, G so that the eigenvalues of A — GC all lie 
in the left half plane, and r must be sufficiently small. 

For nonlinear systems, the situation is more com- 
plicated. One case, however, is easy to understand. 
Consider a nonlinear closed-loop system x = f(x,u(x)) 
whose linearization, x = Ax + Bu(x), at the equilibrium 
x = is asymptotically stable such that there exists a 
matrix G so that all eigenvalues of A — GC lie in the 
left half plane. In this case, the continuous system 

x = f(x,u(x)) 
x = f(x, u(x)) + GC(x — x) 

will be locally asymptotically stable. In fact any system 
with correct linearization will do. For digital control, 
one may choose, for example, the following system 

x — f(x, u(x)) 
x(t) = x k , for rk < t < r(k + 1), (3) 
x k+1 = A d x k + B d ux k + G d C(x k - x k ), 

where A d = exp(rj4), B d = /J" exp(— sA)dsB and G d is 
chosen such that spec (A d — G d C) = exp(r spec {A — 
GC)). If the sampling time, r, is sufficiently small, then 
the system (||) will be locally asyptotically stable. 



2 The Control Law 

In this section, we briefly recall a method for construct- 
ing an infinite dimensional family of controls laws for 
many nonlinear systems. We will then use the method 
to derive a specific control law for an inverted pendu- 
lum cart system. The implementation of this control 
law including a sample time and a state estimator will 
be discussed in the final section of this paper. 

Let Q denote a configuration space. Let g £ T(T*Q® 
T*Q) be a metric. Let c,/ : TQ -> TQ be fiber- 
preserving maps. We assume that c(—X) = —c(X). 
Let V : Q — ► R. The system that we consider is 

V^7 + c(7)+ grad^V = f(j). 

Let P £ T(T*Q <gi TQ) be a g-orthogonal projection. 
We consider the situation where a constraint P(f) = 
is imposed. A system is called underactuated if P ^ 0. 
In order to describe the final control law, we will use 
several other variables. The variable g £ r(T*Q®T*Q) 
will be a metric, c : TQ — > TQ will be a fiber-preserving 
map, V will be a real- valued function, and A £ T(T*Q® 
TQ) will be a <?-self adjoint map. One first solves the 
equations 

V 9 X \lm p®2 = °> 
for A|j m p . Then one solves 



I, 



■9 = L px9 



(this is a slight rewrite of equation (1.12) of our previous 
paper [§), 

L V = L V 

^ XPX y ^ PX y 

(this is equation (1.13) of our previous paper Qj), then 
after solving, 

P(c(X)-c(X))=0, 
the control input will be given by: 

f(X) = V X X-V X X+ grad^V- grad V+c{X)-c{X) 

(4) 

We now apply the above method to the inverted pen- 
dulum cart depicted in Figure 1. 

With appropriate scaling, the metric g is given by 
g = d6 2 + 2bcos(8) dxdO + dx 2 , where b is a physical 
parameter, < b < 1. The potential energy is given by 
V = cos(#). Since no torques can be applied directly to 
the pendulum, P = (bcos(9) dx + d9) ® d/d9 is the or- 
thogonal projection onto the direction d/d9. Assuming 
that there is no dissipation, c = 0. 

Let 6 be the coordinate with index 1, and x be the 
coordinate with index 2. Writing XPX = er^| + /i^, 
where a and fi are yet to be found, the A-equation may 
be rewritten as 



— ( 




Figure 1: Inverted pendulum cart 



-^-{a + bcos(6) f i) = 0. 

For these equations to be consistent the following com- 
patibility condition must hold: 



d_ 

dx 



(sin(0)/i) = 0. 



This implies that fi is a function of 9. The second A- 
equation implies that a is a function of 9. The first 
A-equation then becomes an ODE which may be solved 
for a giving, 



a(9) = cr + - bcos(9) -2b sin(t)/i(t) dt. 

Jo 

Before solving the ^-equation, it is helpful to solve, 
dy . dy 

a Y9 + ^ = - 

Using the method of characteristics, we find, 



y = x 



dt. 



The ^-equation may be rewritten as 



Of i 



dgn dgu ,da a dfi 

a ^r + fI ^x- + 2i d9-Hd9 )gil + 2 7 



0. 



Let a and [i be a and /i considered as functions of 9 and 
y, i.e., 

a(9, y(9, x)) = a(9, x), fi(0, y(9, x)) = (i(6, x). 
The solution to the g-equation is then given explicitly 

by 



b cos(d)n) + 2b sin(6») fj, = 0, 



where h(y) is an arbitrary function of a single variable. 
Using the definition of A, we have 

1 , 

.912 = -(1 - <rgii), 



?22 = -(&COS(0) - CT512). 

Using integration by parts and the first A-equation, we 
can simplify the integral appearing in 511 . Explicitly, 

1 croM 2 bcos(6)fi bfj, 2 fi 2 

gu{0,x) = — 2 1 2 + — h (y)- 

The function V satisfies the equation 
8V 8V 

Considering V as a function of 9 and y, this becomes 
an ODE. The resulting expression for V is: 

V(6,x) = w(y(6,x))- [ S -^§-dt, 

Jo cr(t) 

here w(y) is an arbitrary function. Finally, the solution 
to the c-equation is given by: 



w(y) 



c 1 = -bcos(9)(c 2 -c 



2 c 2 ) + c\ 



where c 2 is an arbitrary function which is odd in the 
velocities. The final control law is given by equation 
(I- 

For the inverted pendulum in our lab, the parame- 
ter, b, is .238, and c = 0. (In practice, there is some 
dissipation in the base of the cart, but this may be di- 
rectly counteracted by a term in the control law. The 
dissipation in the joint holding the pendulum is really 
negligible.) The value of b is different from the value 
that was used in the simulations in 0]]. This is because 
we are now taking into account additional contributions 
to the mass of the base of the cart and to the mass of 
the pendulum. 

The control law studied in [Jj] stabilized a wide range 
of initial conditions, however, it was found to be under- 
damped for small initial conditions. This was not diss- 
apointing because the arbitrary functions in our control 
law were chosen for algebraic simplicity, and not for 
specific engineering goals. For this paper, we decided 
to use step functions in place of some of the constants 
used previously. By using step functions we hoped to 
reduce the number of parameters to something which 
would be reasonable to analyze. Our plan was to try to 
blend the nonlinear control law which worked well for 
large disturbances with one which would linearize to 
the linear control law that worked well for small initial 
conditions. In particular, we took 



H(9) = 



fi cos(0), 

^oo C0s(6>), 



for \0\ < 9_ 
otherwise 



%) 



ho, for y < y L 
/ioo, otherwise 



±w y 2 , for y < y L 



otherwise 



The entire motivation for this method is that #(7) = 
§5(7)7) + ^(7); is a natural candidate for a Lyapunov 
function for the closed loop system. The time derivative 
of H is, —g(c(X),X) = (det<?) • c 2 • (fio c os99 — aoi). 



Thus taking c 2 = <J>(// cos 99 
is never increasing. We take, 



oqx) will insure that H 



$ 



for \9\ < 9 L 
otherwise 



With these choices, the function a will take the form, 
o , for |0| < 9 L 



a(9) = 



Ooo , otherwise 



where Ooo = o + b([io — Hoo) cos 2 (0l). We guessed 
9l = .3 and yL = 15. Values which stabilize a large 
region are: 

Ooo = --05, = 9.9, Woo = 1-5, $00 = -75, and 
/ioo = -03. 

These are a slight modification of the values given in 
our previous paper, since we are using a slightly diferent 
value of b. To compute the appropriate values for the 
remaining constants, we write the linear control input 
as: ui = g(f, J|) = p±9 + p 2 x + di9 + d 2 x. Setting 
ft lo = Pi, % |o = P2, di<r Q + d 2 Mo = 0, and Ooo = o + 
6(/io — A* 00) cos 2 ($l) determines four of the remaining 
parameters. The final parameter is determined by the 
condition, ^S|o = d\. The resulting parameters are: 

o = -1.59, fi = 17, w = -00296, <J> = 1.48, and 
ho = .0081. 

Numerical results comparing the control law de- 
scribed above with the linear control law are presented 
in Figs. 2 through 5 below. The small initial conditions 
were 9 = 0.4, x = 0, Oq = 0, and ±0 = 0. The large 
initial conditions were 9q = 1.1, Xq = 0, 9 = 0, and 
i = 0. 

3 Implementation 

The inverted pendulum cart in our lab cannot directly 
observe the velocity or angular velocity of the cart. 
Thus, full state feedback is not possible and the modifi- 
cations needed to implement the control law based upon 
the output of a non-trivial linear observer, C, must be 
considered. For our first test of a digital control system 
implementing the control law described above, we took 
an estimator of the form (|^) with r = 0.0143, 

/ 1 0.0143 \ 

. _ 10 0.0143 

d ~ 0.0151 1 

\ -.0036 1 / 
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Figure 2: Linear control law with small initial condi- 
tions 




Figure 5: Nonlinear control law with large initial con- 
ditions 
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Results from our numerical computations of this larger 
system are displayed in Figures 6 and 7. The initial es- 
timated state was chosen to be the same as the initial 
conditions. System (^) was unstable with the large ini- 
tial conditions for both the linear and nonlinear control 
law. 



Figure 3: Nonlinear control law with small initial con- 
ditions 
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Figure 6: Linear control law with small initial condi- 
tions state estimation and sampled data 



Figure 4: Linear control law with large initial conditions 



Figure 7: Nonlinear control law with small initial con- 
ditions, state estimation and sampled data 

4 Conclusions 

Looking for control laws so that the closed loop system 
takes some specified form appears to be a promising idea 
in nonlinear control theory. There are however many is- 
sues which have not been fully resolved. One must first 
decide what it means to say that one control law is bet- 
ter than another. With only an intuitive idea of what is 
"better" we would argue that a control law derived via 
the matching equations works "better" for an inverted 
pendulum cart than a linear control law. This brings up 
the question of finding control laws of this type. Such 
control laws are usually described as solutions to a sys- 
tem of partial differential equations. Just guessing a 
solution based on the form of the equations is not a 
very satisfactory solution to the problem. The general 
solution to the matching equations may be found for 
systems with two degrees of freedom. If there is some 
symmetry present, it is also possible to find solutions 
to the matching equations. This leaves open the prob- 
lem of finding such control laws for systems with more 
degrees of freedom in the absence of symmetry. The 
general matching equations have many solutions. This 
means that one must have some method for picking a 
good solution to the matching equations. 

Assuming that all of these questions have been an- 
swered, one must still come up with satisfactory answers 
to the main questions discussed in this paper: what 
state estimator should be used, and why will the closed 
loop system be stable when only sampled data is used. 
Mathematically, it is well known that the resulting sys- 
tem will be locally stable if the linearization about the 
equilibrium is stable and the sample time is sufficiently 
small. Perhaps some numerical and experimental tests 
will shed some light on the correct choice for a state 
estimation scheme. Given the promising results of the 



matching control law applied to the inverted pendulum 
cart, and the wide array of open questions, this is a 
fertile area for future research. 
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